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ABSTRACT 

The ways in which achievement in a foreign language 
is assessed in German secondary schools are outlined and illustrated 
with examples from th3 testing of English. The overall organization 
of assessment procedures is described, the situations for forms 5-10 
and 11-13 are differentiated, and the regulations governing 
conditions for the "Abitur" (pre-university , school-leaving) 
examination are discussed. Problems in the testing system are 
examined in some detail; it is ncteo that: the system has the 
advantage of flexibility and freedom, which allow teachers to tailor 
their assessment procedures to their teaching methods. It is 
suggested that th#* syste*n contains an untapped potential for 
criterion-referenced testing, and questions are raised about the 
degree of norm- referencing found in the system. (MSE) 
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^ OOSftKjn Of POl'fv 

^ LANGUAGE TESTING IN GERMAN SECO«ARY SCHOOLS - THtORt AND PHACTICT 

sO 
sO 

r\j 

I — \ The purpose of the prttent p«(>er Is to give m etftJIni vt ttw 

, ways In which achleveaent In foreign Iwguages Is etsMitd Mithin 

the context of the GenHn school eystMi. 

it should bt noted that In the ibov* Introtetory swtanoe 
ttm 'test' has been rather carefully avoided Ncim « as will b*- 
coae fully apparent later - the assessmt prooedum «ted In tUt 
Federal liepubllc of Genwny tend to bt both less rigorous mi a»re 
9loba1 than 'tests' In the usual understanding of th« word If 
«t Mintain that tests bt objective, rtllafalt, and vol Id, or that at 
least serious attea^ts be aide to Mke thta such, ihtn vlth v^ry 
txceptlons the procedures by Mhlch ach1eve«ent In fortlw languagts 
Is assessed within the GeriMn school syste* are not tests* In other 
words, there is no tradition of testing In the 'hard' senst of tht 
word. In Genaan schools. 

This Is partly encouraged by the fKt that It fitrtiny, ti a Fed* 
eral Republic, education Is run not by a single national Departacnt 
of Education, with resulting tendencies towards unlfortlty throughout 
the country, but • since education is constltutloMally a aetter of 
the individual states - by 11 Independent Education Otpartaents, tach 
organising Matters In somewhat different ways. In each of the parts 
of the country. In what follows we shall take the situation In tht 
iost populous* state of North-Rhine Westphalia (NRU) as an exa^ile In 
the hope that this will at the same tine Mirror enough of the coMaon 
ground that does exist between the approaches of the Individual 
states, without, however, being able to clala correctness of detail 
for all the other states as well. 

After a brief exposition of 'ihe organlsatory fraaewoHi of 
assesswnt in general, we shall follow the structure of the Genaan 
secondary school systea and deal with foras S * 10 «id 11 • 13 as 
two different groups, before finally turning to the procedures used 
In the final (pre-unlv^rslty level) school •leaving exialnatlon, at 
the highest level of a student* s school career. In etch case, we 
shatf present the official rules and regulations as Issued by the 
Departnent of Education, and then try to explain In which way these 
tend to be l^leaented by teachers In the cUssrroa, thus attlng at 
a survey of both the theory and current practice. 



? General Organisatory Framework of Assessment within the School 
System 



Modem languages, as school subjects, operate under conditions 
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**hich a< in no w»y different from those of other subjects The ap- 
propridtf assessment procedures, accordingly, need to conform to the 
general regulations that govern the wa>s in which the results of 
teaching and learning efforts are captured and measured within the 
system in general . 

Tor North-Rhine Westphalia, this aoneral rramework is laid down 
in the Allgewgine Schulordnung (General School Re •:*Mons) of 1978, 
**h1ch stipulate. In § Zl, that all assessment must ^ both 

knowledge and skills and needs to be based on alj[ as» ' a pu- 

pil's work. In particular (i) on written pieces of wot elicited 
by a prescribed nui»4>er of Klassenarbelten (written cU 3foom tests), 
i^ich carry half the weight of the total assessment, and {U) on 
what is called Sonstige Hitarbeit (other work), which accounts for the 
other half and Is usually equated with the 'oral' aspect of classroom 
work although its definition Includes participation and effort, and 
practical work as far as applicable, as well. 

It is interesting to note that later (§ 22) a careful distinc- 
tion is drawn between the written classroom tests as referreti to a- 
bove and limited written e-ercises as a further basis for assesswnt. 
These are not prescribed, may be marked, count for the 'other work' 
half with the value of a weightier oral contribution in class, but 
are not supposed to replace the assessment of oral skills. More de- 
tails of this important distinction will be presented below (see 
section 3.2). 

These arrangements liiply (i) that assessment is conceived of as 
a Continuous process rather than a once-off events (li) that in spite 
of explicit atteiTpts to safeguard the assessment of oral work there 
IS a noticeable bias towards writing as the basis for assessment, 
since writing-based procedures account for well over half the weight 
of the two assessment (domains taken together 

While it is appreciated that procedures eliciting and evaluating 
woric saiTples at several points over ihe educational year are more 
likply to yield reliable and valid results tnan those making the 
assessment dependant on a single, however massive, examination at the 
end of a course of instruction, language teachers find that the built- 
in bias towards writing-based assessment procedures makes it diffi- 
cult to change the pres'^nt practice of assessing the oral skills im- 
pressionistically, with no prescribed or customary method or format 
OS a guideline, because it <s in fact less important for the eventual 
result at the end of the school year and is considered to be the 
'soft' part of the assessment, against the 'hard' writing-based parts. 
In othe? words, there is a strong tendency for the results in the 
writtpn classroom tests - and possibly the marked written exercises - 
to dominate the evaluation of achievement of a pupil at the end 
of the school year, wUh an ind^pendiint assfssmpnt of oral skills 
oithpr non-existont or only m,irqinal]y oodlfyinq thp ,i<iSPSSfT*»nt pre- 
dptprmined in this w/iy 
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3 Asset samt of English (Fom S - 10) 

3.1 KUssen^Hwttf ff (WrUt«i Clmrooi Ttsts) 

3.1.1 0r9«n1satory Conditions 

The li^rtance of tht writttn classrooii tests for the assess- 
Ment In general Is suitably underllited by the rewgt of mles and reg- 
ulations that surrotfid theei. 

As TABLE I Shows, secondary education starts In the fifth fom. 
Mhlch is the first year of English, and can be folloHH eltHir In 
one the school types of the traditional tripartlu tytUs, I.e. 
Hauptschule (Secondary Modem School), Nalschwle (Sfconderv TecMI- 
cal School) or Cwwasluw (6r«»ar School), or in a •Hi«ttCh»!e (Co»- 
prehensive School). Coi^ulsory school Ina ends after ine vm for«. 
In all schools, English Is coepulsory. The table sets out how M>y 
lessons per week are held In EngU^K as a school subject. In each of 
the school types, how Mny of the prescribed written classrooM tests 
are to be taken per educational year, and how long ttwse tests are 
supposed to be (In periods per test). 

Table 1 



MrltUn Classroon Tests In English (Foms S - 10) 



"Hduptschule" "Reilschule* "Gyemasluw* "Gesaatschule" 

(Sec. Mod. School) (<^ec.Techn. (Graeiwr School) (Coepreh. 

School) School) 
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It Is Interesting to note that although the nuiit>er of English 
lessons per gtetk Is the siMe In all school types. In the nun demand- 
ing schools wore and longer written classroom tests tend to be 
required, a perhaps not quite convincing connection made by the sys- 
tem between frequency and length of measurement, on the one hand, 
and difficulty on the other. 

AU written classroom tests - as all other assessment procedures 
within the school system, with the possible exception of t.ne Abltur 
(see section 6 below) - are set and marked by the teacher of IRe" 
class. There Is an explicit rule (Allgemelne Schulordnunq § 2?) o- 
bilging teachers to adjust the difficulty level of the Individual 
test to the avarage standard of the class. This is ii^jlemented 
through the requirement that In the case of more than one third non- 
passes the test Is to be repeated unless the headmaster of the school 
is prepared to sanction it, as an exception. 

These arrangements are obviously designed to avoid any potential 
gap that might develop between he teaching and the testing of it: 
there is no problem for teachers to make sure that their pupils are 
tested on what they have been taught. It Is equally obvious that the 
arrangements are Intended to ensure that teacners do not get away 
with teaching without proper regard of what their pupils can learn: 
if more than a third of tN- pupils have not been atlc to follow to 
the degree of at least deserving the lowest pass mark for their ef- 
forts In the corresponding test, tht.i the teaching was perhaps not 
as successful as it should have been, and an obllgatior. to attefl|>t 
to reach more members of the class seems reasonable. In this context, 
the 'exception* rule as outlined above apparently functions as a 
safeguard against possible misuse of the general 'one tiiird* regula- 
tion by classes or groups wilfully pursuing a strategy of non ^-oop- 
eratlon, or similar. 

It is not difficult to synpathlse with the pedagogical ethos 
that seems to have fo*jr,d expression ir the regulations described so 
far. Unfortunately, these arrangements tend to have rather problen- 
atic side-effects in that they encourage a form of group-oriented 
norm-referencing - with each class functioning as an Independant 
group - which amounts to a rather extreme version of what Is of 
course In principle ir^herent in any system asking teachers to both 
set and mark their own tents, with few outside reference-points ex- 
cept the individual teacher : ability and conscience. It is tenpt- 
Ingly eas, for a teacher, when che results In a particular classroom 
test threaten to fall under the 'one third* rule, to sinply raise 
the general level of the marking a little, rather than to go through 
the time-consuming proces> of setting and marking another test on 
the saw fieid at a later stage as long as 'he marking is Internally 
consistent within the group, thete is no lirwedlate outside reason why 
this should not be done. 

The consequence is that given marks are extremely difficult to 
compare across the system, as there are no established prodecure' of 
takinq thp diffe-pnt averaqp^, the irjividual groups into account. 
Marks are therefore {more or ]es,) useful indicators of the rank of 
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• iMTHir in rtmioei to hli Mi fTMp. IMt »rtctlOl1|r^<»1»l»r- 
prttililt •$ IMIcitors of ocMtMMt icrotf ^'••••J^cfcOtU. or 
rtolons: «Mt Is mro«i In e«t frw^ m «i1 •••• 9r ^ 
trirt In so«t otNr vrtHB of (fon^llyj tUt %mm HftljO nitir«l 
ctmstqutnctt of icciatnul rm tmo^Him m6 ••r«wt< V sy»- 
t«fl«tic vtrUHons In tHt airtlnc Hitolts of ttidim. Tliwt. Iwcl- 
dentallr. hovt rtpMtitlow tc 'hird' or 'lOft ■wrtort jrtWn IMIr 
schools so th«t ptoplt (l.t. confirm, jr^*«> ttM 

ipprtclaU • good ••r* frwi ttoditr X n tqulMlont to « iwrop 
mH( fro» teachtr t. etc. 



Thor« ar« tuo c^idltlonol «tts of orfwlfi*ory ^Jw - , 
«1th tht MTltttfi clmroooi toits ttfildi trt •^J"tomthtrt 
Allowtlno SdHilordmmi t K). To ivoltf surpHto ottadtt. tM 4rtot 
of wrUitn cUssrooii ttstt to bt vmomtd In odvifie. 
to bt i»Tt«d. thw r«turfitd to. md distmtd with, the (wt 
• ISO ntxt section btlow). tlitn olvon to tht pupils to ttkt ho«i for 
thoir parents to soe. m6 flniTly to be rtUmiod to tht school. 
Further, they tre to be spretd tvtnly over tht tdvcitlonal 1^- 
plls tre not to be given ■ore then one on »y single d«y. md there 
are to be no «or« than two in my iMi. 

Mtlle both sets of mles Mite obtrlows pedifOflcel eewe, the 
second one Is reth#r luportent In contrlbtftino to the prtsitrt to 
adjust M»e ■irking of a test, ^n the way outlined above, to avoid a 
reoetltlon. Since pupils have to take written classrooa tests not 
only in one subject, but In Many others besides English. t««V.<^I^ 
•re usually co-ordinated by the various teachers of a class and fl«ed 
veil in advance. In order to a»et the above orean1satery^ft^1rt«nts. 
Any later change threatens to overthrow the Intricate balmoe of the 
various dates for the required nui^er of tests In %hz different sub- 
jects, and the obvious result Is that there Is a strong Interest In 
avoiding the repetition of a test altoTCther. as f*r as possible. 

3.1.2 Fonaats 

After the foregoing outline of Vhe wost important organlsatory 
requlre^nts connKted with the prescribed written c 1 as sroo« tests 
It 1$ now appropriate to look eore closely Into the nature of the 
formats used for this purpose. 

Again, we can start froia what Is officially laid down. In this 
case In the RIchtUMen (guidelines) of which there is a set for each 
of the subJecTs laught at school and irf»1ch are Issued by the Nlnlstry 
of Education. 

Taking the Ulcht Union for the Sraenar Schools as our Min ex- 
amle (KultuselnUUr M ed. 197ab), the six years frm the 5th to 
the 10th f0T« are grouped Into three two-year bands, with the folltw- 
inq ex«iv>les or recownwndatlons for the written classroom tests: 

(1) f onw 5/6: snswer quest1ont» form questions, describe pic- 
ture, verbalise picture story, gWe sl^le explanation*, change 
dialogue Into narrative or vice versa, retell a text changing 



-150- 



the point of view (e.g. from 'He to 'I ...'). A few ttch- 
niques are explicitly not reconrcndedj in particular dictations 
(neither of known texts, nor of slightly changed ones, nor of 
entirely unknown ones), the rendering of a text learnt by heart, 
the suflinary of a text (or part of it) read in class (cf. Kultus- 
minister NRW Pd. 1978b: 19). 

(ii) forws 7/8 - all of the above at a more demanding level, 
plus e.g. characterizations of people, objects, events; sum- 
ries (including structural analysis, main ideas, cowwents on se- 
quence of events); analyses (at a fairly elementary level, at 
this stage) of stylistic/linguistic properties of given text 
types; changes from one text type (e.g. letter) to another (e. 
9. interview with letter writer); production tasks such as 
'Describe the school day of a British pupil' (after treating 
the topic of school life in Britain \n class ever a period of 
time) (cf. op.cit. 37-38). There is an explicit note saying that 
Integrative formats should defin tely predominate, at this staoe 
(cf. op.cit. 32). ^ 

(iiO forms 9/10 : all of what is characteristic of the abovt 
group, only al a more demanding level and with particular eiih 
phasis on the analysis of fictional and non-fictional t^^ts, e. 
g. work out the structure of the text, the pros and cons, plot, 
characters, historic background, comment on style/register etc. 
(cf. op.cit, 55). Again, explicit reference is m^de to the need 
of using integrative formats which alone can do justice to the 
con^lex objectives of the teaching at this level. This is con- 
sidered to be more inportant than the loss in objectivity which 
this approach inevitably entails. "Die mit Jiesen Formen ver- 
bindtne verminderte Objektivitat der Lei stungsbewertung mA Hit 
m Kauf genontnen werden.'* (op.nt. 56). 

An attempt to see these guidelines in perspective reveals two 
interesting tendencies. The first is that written classroom work Is 
clearly intended to <;?t the model for *\e assessment formats efn- 
ployed to monitor the learning progress. In other words, the written 
classroom tests are to elicit work samples representative of the 
written activities performed ir. class, so that there <s in fact an 
identity between exercise and assessment formats. Teachers tend to 
be rather in favou*" of such a scheme, to *e sure for good pedagogical 
reasons 

The second tendency is less apparent in the letter than in the 
sp rit of the guicielines, which implicitly favour a criterion-refer- 
enced approach - by outlining le,^rninq objectives and recommending 
assessment procedures asking f'^r judgments as to whether and how far 
tb«se objectives huve been re< :h€d by the ^t^rners - in spite of, and 
in cixitrast to» the strong norm-referencing ^^ich is suggested by the 
rxtprn,J framework of the assessment system in general (cf. previous 
section). WKethor these two contradic triry approaiheS can be re-oi* 
riled in a meanuiqful way. whethe" ♦hpy cancel each other out to lose 
tho advantages nf them both, nr whethor this sinply leads to a situa- 
tion whnre ,)nythinq qoe% anrf nn nbliqation is feU tnwards any of 
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tlMnt princlplet, tfttts leaving the exact pttrpott of IN •«ttst«0it 
coiivtnltntly In ^he dark, It a question on tiilcfi little InfOf^tlon 
Is available to date and tihlch can only be raised rattier than jone 
into here. 

PrKtlcal realisations of the rtcoMfidatlm of the wldtllnH 
can be found In the Richtllnlew tliemelveSt ^Ich frequently driv 
attention to assessment fomats uhen dlscusslnu ewrclses considered 
helpful In achieving the learning obJectlm. In addition, tliere are 
a nuatier of useful publications available as tielp for the te^ctier 
(e.g. SchuU et al. 1984) i^ilch provide detailed discussions of con* 
Crete exaiiples an? often Include marking end grading suggestions at 
well as hfindy bibliographies (?). 

3.2 Tests (Marted Written Exercises) 

The et|»has1s on Integrative fonMts et described dbove dots not 
Man that discrete Itew forwats sudi as series of Multiple choice, 
true-false, Matching, fill-In or siMllar 1te«s, i^lch are usually 
associated with objective testing, are not Kceptable within the Sys- 
tem of assessnent at all. But thev are considered nelnly suitable fot' 
checking off soaie of the «ore Isolated, aechanlcal etpectt of lan- 
guage and bre thus given a eore llialted r01e: tettt contftting of 
tasks with these ^ormatt fall outside the regulations ooveming the 
prescribed written classroon tests, they are non-co«|>ulsory. and 
their results count towards the 'other work' area (cf. section 1 a* 
bove: cf . also KultusaHnlster NRW ed. 1978b: 11). 

Within the context of the whole systeai, this distinction, 
which Is no doubt quits rational as such, unfortunately encouregn 
two types of iilsundet standings which contribute to making the 'other 
work* half of the ass..ssnent a rather problaiaatlc field. 

Th€ first Is that In spite of explicit exhortations to the con- 
trary (cf . Allfiielne Schulordnung 5 t2) discrete Ue« tests, with 
their status or (non-coii|>u1sory) Marked written exercises, are easily 
confused with a 'hard* way of Measuring oral coniMtence. In fact, 
even the Richtjinlen theMselves, In this case the ones for English In 
Comprehensive Schools, expllcltry Make this very assumption in a 
somewhat surprising statement suggesting thst obstrving and assessing 
the oral coMmand of the language can very well be carried out < y In- 
formal written tests; 

Es wird ... hlufig notwsndig sein, eUndllche Eertlgkelten wis 
Sprechen aus Grlinden der geslcherten und schnelleren Bewert- 
barkelt durch schrlftliche KontrolU erf a^iren 2u UberprUfen. 
(KuUusmlnlster NRW ed. 1980: 14?). 

The second Misunderstanding connected with discrete IteM tests 
within the oresent system Is that they are In fact not quite so 
'hard', I.e. objective, measures as one might think, because they are 
connonly 1n9)1eq«nteo as quickly assembled lists of Individual Items, 
with little attention to the technique employed and the validity and 
rellabinty of the Items Included. In keeping with the tendencies of 
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the systew in gcnenl. they are teacher-nwde and used individually 
for a particular group at a particular tine. No pre-iestirg is done, 
nor are there any other steps taken to ensure that they can at least 
develop into anything more than isolated Idiosyncratic snapshots of 
i^ich language items the learners happen to 'know'. 

Although these marked written exercises are comionly called 
Jg^t^ ^n the Gerwan school systew, In contrast to the prescribed 
ICIassenarbeiten (written classroom tests) described in the preceding 
sections, they are in fact rather remote from tests in the real 
sense of the word. 

While teachers, understandably enough, often do not have the 
expertise, nor In particular usually the time, to inprove the test 
qualities of these home-made 'tests' themselves, there is a somewhat 
surprising reluctance to use e.g. existing standardised tests, where 
after all this work has already been done for them. One may speculate 
that these are perhaps not sufficiently well known; it could also be 
that differences between various groups are so considerable that 
these tests are vaguely felt to be too remote from wh^t is actually 
being taught in this particular classroom. 

The alternative could be to develop the 'tests' into a netwo?< 
of criterion-referenced assessments, as another way of gaining a ref- 
erence point outside the class for at least part of the total of the 
assessment procedures used. Again, It wculd be possible to draw on 
published tests of this nature, but again teachers appear reluctant 
to use them, possible for similar reasons as above. 

The i^ress'.oo one gathers from an analysis of the Tests (In the 
curiotis understanding of the term given to it in the GermarTschool 
system) is that they are not an area of great interest or concern for 
teachers who are under enough pressure in other fields not to worry 
too much about this one. Considering the rather limited weight 'tests' 
have, as no more than non-conpulsory parts of we half of the total 
assessment, this negiect is perhaps not total ly surprising. 



4 Correcting and Marking of Klassenarbeiten 

What is accepted as more important, on the other hand, is the 
need for some kind of uniformity in the correcting and marking of the 
- more inportant - written classroom tests. In order to gain some in- 
sight into the problems connected with this field, it might be inter- 
esting to see which suggestions were made in a recent in-service 
training meeting (Landesinstitut fur Schule und Weiterbi Idung Novem- 
ber 1984), and to add sotnc comments on them 

The problem of awarding an app'^opriate mark within the range of 
the marking scale pre<,cribed by tno system is only vaguely touched on 
by a reference to the learning and teaching objectives as laid down 
in the official guidelines (Richtlinien) already referred to previous- 
ly' inhowfar these have b^en reached in a given written classroom test 
( Xiassenar hPjt) rpm;nns onHrply ,i mattf'r for the individual teacher 
to , {. nr. »n < • ^-n nrf i^tr) ^ ^^rk Nn quirlelines are offered for 
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ttils mt problmitlc tiftct tf mv mmmmi. HhIADiim jq, Wmn 
tvtr, consldtrtd wort tppmprlit* In coiMCtloii with Vm corrtctlofi «i4 
Mrk1fi9 of Hlstakts. 

All MlstiAtt art tc b% Mrktd «i4 cImlfM ii to kIM mi 

?ravUjf. following cattftrlts «r« to fei tmi mi 1Mfc«lo< 
hf approprlatt ibbr«vUt1on: 8r - 6r— wftlfc (grcMr). T - Tmmm 
(UnsO, Bi - Nilthwi (concord), - SatiNli (s|iiUii|« St ^ sUU 
lung (word ordFTTTr^ PrMpotltlon (prIjmttToii), N - (tiiTFil 
Tlti), A - Ausdru ck ( Co i location, tJiomsloiift wf Mnt tRiMM i«rd), 
K - iochttcTtriTFynq (ortliogriphvK I - Zyl rhiniitu m (p^rtiigtlin) 
All of tfiese count as ono Hlstwo, oxoipt for llio last tww idilcfii 
count only at 0.5 error unit. Houtver, In dlctailont idildi art con- 
sidertd acceptable only (If at all) at a rate of nt wm% tkm ana par 
half year in foras S «d 6 - orthoar«ph1c arfstafcta m}m C9IM| m one 
Mttole error unit. There Is an axpllclt re wl n dar that c^ly Uiett to- 
perfections In the pupils' papart art to be counted aa vlftilM which 
can be shown (e.g. by dictionary, granwr book, re f arenoa book) ta be 
definitely wronQ: It Is not enough for thaai to Just 'aound wrong' to 
the teacher. 

A nuiber of additional specif icatiant prwrlde mllnga far Indi- 
vidual problem. There Is a mxIm of onw alstaka par word. A * arts- 
takes, t^lch by definition extend nvar nore than one word* count aa 
one single error tfilt, but other nistakes (a^a* ort hu frMi iy , gr«Mr) 
count In addition, «.g. *»a locked after the key' wauTd have one A 
and O.S K Mistakes. Orthografifiy counis as one artstake If the rt^^l^ 
is a dlfTarent word, e.g. ' thert hoUdw'* Slartlarly^ If orthoriP^y 
Is connected with gramr it counts as a (full) £ - ai1staka» e.g. 'In 
It's nest*. Recurring Mistakes are narked but counted only enoe; how- 
ever, tense errors count OKh tiae unless there Is an Internally con- 
sistent Unse shift; recurring elewantary errors (e«9« In connection 
with the 3rd person singular -s) are treated as other rKWrrln^ arts- 
takes but If frequent are to "Ee taken Into consideration when deter- 
wlnfRg the final wark. 

After the correcting and aarklng. the written classrm tests 
are to be returned to the p(4)1U In class. Teachers are ei^iad to 
discuss the tests so thjt the pupils (l) understand tdiy they have 
been given the Mrk they have received and (11) cm correct their own 
tests. The explicit idea Is to help pupils to avjid iiAIng the saaw 
Mistakes In futvre. 

It can be assuMed that sinllar suggestions are In principle In 
operation In Many ar>as anc' countries. Mhat Is perhaps not quite sat- 
isfactory Is that Many of ^he error categories overlap considerably, 
so that ^he clarity sugvCated by the abbreviations Is More apparent 
than real. Considering the orthography probloMi even of native speak- 
ers of English, the recategorlsatlon of soMe orthographic Mistakes as 
lexical (there - their) or graawMtical Mistakes (its - It's) is not 
entirely convincing. And inhowfar discussing the te?ts Tnclass when 
returning thew to the pupils contributes to helping thew to avoid 
making the smw Mistakes in future is in fact rather a thorny question: 
there is little doubt that more systeMatic follow-up nork than is pos* 
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sible within the one period usually devoted to it would be needed fo-^ 
this aspect of clas^rooni work if the procedure is to be more than a 
ritual 



5 Assessment in English (Forms 11 - 13) 

In the above outline of the ways in which achievement in Eng- 
lish is ineasurement within the Gertnan school system an attenpt has 
been made to show in particular the yeneral pattern of assessment 
during the six years of conpulsory secondary schooling, with its em- 
phasis on the written classroom tests, the proolematic evaluation of 
the 'other work* area, and the curious role of the marked written 
exercise. When turning now to the final three years of instruction 
in English offered by the systetn to pupils attending Grantnar Schools 
(and some Conprehensives) it will be sufficient to highlight th3 dif- 
ferences to this pattern, before finally looking in some detail at 
what is demanded in English in the Abitur , ],e. the final pre-univer- 
sity level school«leaving examination 

According to the Richtlinien for forms U - 13 (see Kultusmini- 
ster NRW ed. 1981), the assessment of English at this level is in- 
tended to probe into thrt^e areas, (i) the command of the language as 
such, (ii) knowledge about e.g. language (-•linguistics), texts (-♦ 
literature), socio-cul tural backgrounds (♦history, 'civilisation'), 
and (iii) mastery of methods (e.g. how to deal with an 'unseen* text, 
how to use a monolingual dictionary, a reference book etc.). These 
domains are not to be elicited and assessed independently of each 
other, but learners are to be given the opportunity of demons tr ,.t ing 
their abilities in all three of them. 

While the way in which this is envisaged wi H be sketched out 
below it is inportant to note at this stage that these demands con- 
stitute a definite shift and widening of the scope of assessment to 
include, above and beyond the foreign language as such, a strong con- 
tent component (if we leave the 'method' aspect out of consideration 
for a moment), as a legitimate part of the total evaluation: in order 
tc be successful in English it is now no longer enough to have an 
acceptable conmand of the language, but it is also important to be 
able to cope with the information retrieval and processing as it is 
required by the contents to be carried by the foreign language. 

Since there is a considerable degree of overlap between what is 
demanded here and in other arts subjects (such a German as mother 
tongue, other foreign languages), in particular as far as TCthods, 
but also as far as some content areas are concerned (knowledge about 
language, text types, literary analysis etc ), high correlations be- 
tween an individual learner's suce<is in English and in these subjects 
can be exppcted On the other h^nd. at a stage where a 'oreign lan- 
guage has been taught for over six years, langjagp can only be ex- 
pected to develop further in connection with contents that can be 
taken seriously and is a real challenqo, so th?»t there are many good 
reasons for broadening also t^e hasi'; of assessment in this way. 
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5.1 Sonstlqe Niurbfit ('Otlwr mrk') Owin 

Tbt basic patUm of asMSsatnt It ttlll ttMntlally tiM tm 
as th< one described above for the younoer ytar Wie 
assessMnt of achleveacnt Is based on (1) a oretcrlbtd miiAer of 
teacNr-Mde written clostroo« Usts (now called Kl eyir) . and (11) 
the Sonitige Witarbtit (*other tork'). 

Generally, criterion-referencing Is ea^atlztd mam strongly at 
this level, with the resuU that the 'one third* rule (!•• 3 M 9r 
bove) U In fact sonvwhat relaxed (cf. KultusaHnlster NRN fa. IMl: 
12M22; cf.. however. 169). 

There Is a strong ^ii|>has1s on the cqutal weight of tlitit tm ts- 
sessMnt donalns, underlined by the requlrtRtnt to explicitly swh 
Mrlze. In a separate Mrk each, the results of the written clKsroon 
tests V on the one Ijwd. and of the 'other work' doMiln. on the other, 
before drawing the two together into « single Mrk for the subject at 
the end of each half-year (cf. op.clt.: 122). The luportance of the 
second domain of assessment Is further ^ephaslzed by the fact that 
for some puplU In the final year, for whom the written classroon 
tests are under certain circumstances no longer coi|)ulsory« It may 
even constitute the only bMis of assessment In the subject (cf.lbd.). 

This makes It necessary for the Richtllrlen to sptll out In some 
detail how the domain of Sonstlq^ Kitarbelt Is to be Interpreted (cf. 
op.clt.: 122-129). A basic distinction Is drawn, for this purpose, 
between continuous assessment procedures on the basis of observation, 
»)d nore formal assessments of Individual pieces of work at Individ- 
ual points. 

The first approach Is considered to be particularly appropriate 
foi* the evaluation of the oral work done In -iltss. t^re an assess- 
ment at one or two Individual points only Is felt to be too limited 
to capture a fair saaple of a learner's contributions to oral class- 
room work. There Is no doubt that the assessment of this field Is 
Intended to be the weightiest part of the 'other work* domain: there 
Is an explicit note saying that - In conjunction with an assessment 
of the homework (see below) • It mi^ well suffice as the basis for an 
assessment of the domain as a whole (cf. op.clt.: 124). 

However, In spite of a detailed list of criteria that can be 
taken into consideration when evaluating oral performance at this 
level (cf. op.cli.: 149-150). teachers and pupils feel rather uneasy 
about the subjectivity of the 1ii|)ress1on marking that Is practically 
unavoidable In this field. In a situation where teachers for good 
pedagogical reasons refuse to rush to their note-books to record a 
mark evfry time anyone says anything In class, and where they teach 
up to six different classes every morning, the only wi^ fir the con- 
scientious teacher to arrive at a broad basis for the eventual assess - 
ment of the oral performance of his pupils Is to systematically record 
marks from memory after school on the pupils taught that day. Under 
these circumstances, however. It Is already sufficiently problematic 
to accurately recall who said whit, to make a systemat': application 
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of fie cr1ter<« suggested practically Illusory. 

The second ipproich to the evah«at1on of the S onstiqe Hitarbelt 
doMiln consists in the assessment of pieces of wort elicited at indl- 
viduil points over the school /ear. Four twoes of work are recom- 
wen<?ed as nirtlcuUr^y suitable, in a subject such as English, for 
th;s purpose (op.cit.: 1?4-1?9), viz. (i) howework, which at this 
Tevel Is roosl^ red to be complementary to classroom work and c«n 
e.g. io be c. a preparatory nature, (M) the kilnutes of « lesson, 
^e. L somewhat detailed suiwiary of the main points covered, (iii) 
marked written exercises (on which more below), a.id (iv) prepared 
talks on special. Individually ^elected topics. Of these, only the 
marked written exercises lead to a direct comparison of all ncfffcers 
of the same group; all the other types are usually interpreted as 
pieces of work i^lch Individual learners may be asked to do and hand 
In and/or read out In class, to be given a .T^rk for Individually. 

Th1> constellation tends to put the marked written exercises 
Into a more prominent position. Consequently, a numbei of rules are 
in force to define their rSle more precisely and determine the organ- 
isatory framework In whirh they are to be used. As far as the latter 
is concerned, there are to be no more than two of them per half year. 
No mo-^e than two markeo written exercises in different subjects may 
be taken by a pupi! rn any one day; Mhen a pupil is due to take a 
written c^«<;sroom lest (in any subject) no marked written exercise 
is dl lowed for this pupil at all on the -.ame d^y. Advance notice must 
be given, and the tasks set must allow cofrpletion within about 30 
(and an absolute maximum of 45) tiiinutes. 

Ih? m^^rked written exercises are intended to provide insights 
into the wcys in which pupils handle a particular limited though com- 
prehensive question or problem connected with what is being fought 
at the moment. Series of shor* independent quest 'ons are explicitly 
ruled out, as are e.g. vocabulary tests (op.cit.: \27). Although in 
practice these latter stipulations are perhaps the >^egulations most 
frequently ignored in the whole context of assessment it is quite 
clear that the n;arl(ed written exercises are meant to be short ver- 
sions cf the written classroom tests. Interpretations e.g. in terms 
of discrete item fomats, which are still conceivable tor the cor- 
responding purpose in the lower forms (cf. 3 2 above), are not in 
accordance with what is intended, at this level 



^•^ >^J^"S"ren (WrUten Classroom Tests) 

As pointed ol: above, the assessment of arhievemefc is based, 
in equal parts, on the 'other work' domain, some details of which 
have been highlighted in the preceding paragraphs, and the prescribed 
written classroom tests, to which we shall turn our attention now. 

The organisatory arrangempnis for this domain are in principle 
comparable to tl.r one*: for the lower .orms (cf. 3.1 above). TABLE ? 
shows that at this level Tnglish can be taken as an ordinary si-bject 
(Grundkurs) at three ]p^>sons per wpok » or as one of the two major 
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mit 2 

Written Classroon Ttsts In English (Forw 11 - 13) 
taktn ts 

ordinary subject Mjor tMbJtct 

( Grundfcurs ) (LtUtwtslnirt ) 

fe k 

? I :^ ? I 



- _ s : 2 3 

■ OIL. «t ^ 9L. 
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11. 1 3 2 2-3 6 2 2-1 

11.11 3 2 2-3 6 2 2-4 

12.1 3 2 2-3 6 2 3-5 

12.11 3 2 2-3 6 ' 3-5 



13.1 3 2 2-4 6 2 4-6 

9 

13.11 3 1 3 hrs. 6 1 S hrs. 



subjects ( lelstungskurs ) required of every pupil In the final ytart. 
at 6 periods per week. The school year Is divided Into two halves 
(marked as I and II In the table), with In sonc cases slightly dif- 
ferent regulations each. The final written classroon test In 13.11 Is 
given In hours Instead of periods* as approxloMtlon to the Abltur 
regulations (see section 6 below). 

Learners are not to take mre than one of theu In any subject 
on ary one day, and no more ihan a mxIihm of three per week. He have 

mentioned before ^hat under certain circumstances some pupils are not 

required to take 'he written classroom tests \i\ the final year at all: 

these pupils arv nut ^tloned to take them even If they w1^ - which 

they might want to do feeling happier with this kind of wr<Hr» 

than having their assessment b ed entirely on the *other wo*^ > 

- Dor Is It possible for them lo be given a marked ^ bitten i 

whIU the others do the Klausur . An interesting note stipu 

a written classroom tt^t must have been handed back to, ano u w««ied 

with, the pupils at least a day beT^^e the next one cart be given (cf. 
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op.cit.- 169), as a - perhaps not entirely unnecessary - reminder to 
IVihVn^ °^ pedagogical, m addition to the measuring, purpose 

As learners at this st ge In their school careers are no longer 
taught In stable groyps Identical for most subjects but have In fact 
hid! V. dual timetables regrouping them for practically all the sub- 
jects they take, a lot of orgamsatory dove-tailing - usually com- 
puterised these Hays - Is required to meet the above conditions 
Dates for the written classroom tests ar» worked out by the school 
administration, instead of the teachers, and are consequently felt 
to be prescribed f.^m outside in a much stronger sense than in the 
lower forms. There is no doubt that pedagogical considerations such 
as giving a test when the group is ready for it rather than two weeks 
before that stage or three weeks after starting on a new area already 
plays no part in fixing the dates, on v*h1ch teachers have practically' 
no Influence at all anymore. ' 

In keeping with the broadening of the assessment to include a 
strong content conipone» t as well, the evaluation of a written class- 
room test IS based on an assessment (i) of the content, where errors 
would resu t from factual inaccuracies or logical inconsistencies 
etc and (11) of the language, where errors would result either f t om 
prob ems with formal aspects of the language (with correction rules 
simHar to those outlined in section < above ':,r the lower forms* cf 
op.cit^ 168-169) or from problems with what is called 'text produc-' 
lion which is Interpreted as the overall composition of the text 
produced by the pupil (cf. op.cit.: 167). It is recognised that lan- 
guage problems cannot always be attributed clearly to one or the 
oth*>r 0' the two language fields, but teachers are advised to take 
car. that individual erro-s are counted only in one of them (op.cit.: 
16"^) The overall mark awarded for a written classroom test is the 
result of a separate assessment of the content and the language, with 
the evaluation of the language as a rule the weiqhtler factor (cf. 
op ci t . : 169) . 

The most problematic part of these regulations is pern.ips the 
separation o^ the language part of the assessment into a formal as- 
pect on the one hand and a style/composition aspect on the other. 
Th s is Obviously intended to make it possible to strike a balance 
between these two - often non-correlating - aspects of a learner's 
written effort. However, the problems of operationalisinq the style/ 
conposition aspect into anything more than inpression marking, or 
inspired guesswork, are considerable. Th.s, it is perhaps net unrhar- 
acteristic of the situation that the overlap with the content area 
Jwhen It comes to an assessment of the 'composition', i.e. the effec- 
tiveness of the presentation of thP points made) which is after all 
para He 1 to the recognised overlap at the otht^r end with aspects of 
the language form pn particular concerning lexical items), seems to 
have escaped the RkJ^eji's notiro In practice, therefore, the 
evaluation of the stTW^^Trrpos 1 1 ion aspect is u«^ualU ronsiderod to 
be thP softest- part of thr> ovoral 1 assossmrnt which can be used to 
justify the mark whuh a tost appoars to desorvo ^n the frst place 
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6 Ablty - Asstsmnt In EfifjllfN 



To roynd off our turvty of wayt Mhidi MliltvMMit In 
En9l1$H Is Mnurtd within Uit Gcmtn school sjrtt«a« m tm finally 
focus briefly on the arrangMnts iHde in coimtctiM vlUi prt* 
university level school-leaving tianlnatlon (AblUr), for this piir« 
pose. 

In accordance with the fetitral ftnjgr rtfii1«ti«if « tN Ottit- 

laent In English, as It eventually appeart on the certificate of the 
successful candldaU In fom of a Mrfc, U tn fKt P«e*t1y beted on 
the results achieved within the final two wears In ttie Si*i«ct» end 
only In part on those obtained In the final eiMaLiat^^-vi Itself* at 
a proportion of 2 : U 

The final ex«1nat1on» on Its part, can either take IN fotii of 
a written test slnllar In type to the Klausuren described In the 
previous section, with sn additional oral exanlnatlon only If the 
results In the writien part are Mrfcedly different froM the average 
achieved throuohout the final two years (or If the candliate Hopes 
to 1i|>rove his/her Mark by taking one), or It can take far* tf 
an oral examination alone In cases wC>ere candidates aaet the required 
nun^er of written tests In other subjects. Uhlle the coapllcalad de- 
tails of which candidates take which fona of the exa«1n<Mon are per« 
haps Irrelevant here (for details se^ e.g. Kultusalnlslir MM ed. 
ig82), a short survey of alms, fonaats and evaluation procedures tm* 
both the written and the onl parts may be Instructive (cf . Kultiis- 
m1')1ster ed. 1981: 169-21^/. 

Similar to the Kla^^ regulations, the written examination Is 
to give candidates tTie opportunity of demonstrating their c eia nd of 
the language, of partlci^lar fields of knowledge, and of ada(|uate 
working methods. 

To ensure some »^;nd of conformity In the kinds of tasks Mt at 
this level, an agreement was reached In the Federal r«epuM1c In 1900 
(cf. Sekretarlat der Stkndlgen Konferenz der KuUusmlftUter ed. 1981) 
to restrict the possible formats to the following four types: 

(I) The candidate Is given a text (fiction) of ab<Mt 700 words 
(major subject; tlm^ allowed: 5 hours) or 500 words (ordinary 
subject; time aU.iwed: 3 hours) (^ 100 words) plia 4 • § fues- 
Mons specifying what Is to be done with It, touching m content, 
form and an evaluation of the text and leading frtm c^J^rehension 
to production. 

(II) The candidate Is given a non-fictional text, with tasks 
specified as unrVr (1). 

(1i1) The cwdldate Is given a combined task *Type A', which 

consists of 

(a) a listening comprehension passage of 300 600 words (maxi- 
mum of 4 minutes on tape) with 6-8 narrow questions eliciting 
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**Jor content points of, and ccwnents on, the text. The proce- 
dure is nirroifly prescribed: (1) listen, (?) look at the ques- 
tions, (3) listen again, (4) answer questions (tine allowed: 
30 Minutes), (5) hand In. Only then is it possible to go on to 
the next part, 

(b) • text-based task (fictioo or noo-fittion) similar in type 
to what Is demanded under (i) or (ii) but 'shortened according- 
ly' (cf. Kultusplnister ed. 1981: 177). 

(iv) The candidate is given a combined task 'Type B', which 
consists of 

(a) a picture, photo, cartoon or simiUr, accwiDanied :>y 3 - 4 
questions eliciting a description and interpretation (maximum 
time allowed no more than one third of the total), and 

(b) a text-bised task similar to (ill b). 

In keeping with th<f tendencies of the whole system, it Is the 
teacher of the candidates concerned who sets the tasks, which, how- 
ever, in order to conform to some kind of coiiwon standard, need to 
be approved of by the regional Board of Education. The procedure is 
for teachers to prepare two packages of two different formats each 
find to hand these in to tne appropriate Board of Education who select 
one of these packages (or reject asking for new suggestions) for pres- 
entation to the .'-andidate who eventually chooses one of the two tasks 
included in It (4). 

The cMterIa for the assessment of a candidate's work are in 
principle comparable to those for the Klausuren {cf. op.cit.: 184- 
187). Harking is done by the teachers who set the examination, with 
another te^^cher of the same school (usually appointed by the head- 
master) act*-jg as second examiner and the Board of Education exer- 
cising it. ower of inspection at its own discretion. 

Of the four formats theoretically allowed, only the first two 
are In regular use, with the other two in practice occurring only as 
rare exceptions. This is of course not really surprising: the listen- 
ing comprehension and * viewing comprehension' sections of the com- 
bined tasks cannot bull J on ary systematic preparation in previous 
assessment contexts and are therefore avoided as uncalcuUble risks, 
they are in addition surrounded by so many restrictive regulations 
(possibly originally designed to keep these two formats from develop- 
ing into 'soft options') that thpy are technically unnecessarily 
difficult to handle; and the text-besed formats are the nwst inpor- 
tant parts in any of tne four versions anyway, in the first two ac- 
counting for the whole, but in the last two still dominating the 
assessment as the weightiest factor by far, so that concentration 
on text-based formats appears rather nore relev«it - and sufficient 
- as preparation for the final examination (5). 

The o)d\ examination in English, as far as it is carried out 

(se- above), also hcs a narrowly prescribed format The alms are 
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%\m\Ur to tliOM of tho irUUfi Ust, «id tUt t«sk It text«4md 
In that tht cwdldatt rtctim a Uxt of ibovt 300 mri$ iflth 2 - 3 
sptcif Icatlont tlicUIno atptctt of contoiit, fori mi lu—ni fro* 
tho caiMlldaU, nho U allootd 30 almit * -*^«or«t1oii. Tlio OJiOirtRl- 
natlon Itstlf ttktt 20-30 almitos, thk dito It tippooad to 
product answtrs to tlit firtt tw tpKlf Icatlont at • Mtlwmt pntt- 
tfitatlon with tht third tpocif Icatlon trtattd In for« of to lotor* 
v1o«» 1.0. by qutstlon and antnor* 

Tho oral txaalnatlfin It condiictod bv a tatll OJMtnottoii ctai^t- 
too contlstl.ig of a chalnian and throo othor Miiort, ono loUig llio 
oxanlning ttachor* m octlng at attottor, «nd ono hotp inf «ln- 
utot. Tho txanlntr U roqulrod to prtparo tKo totlit &d paoo ttai on 
to tht exwinatlon coiMlttoo at loott ttio d^ In otfvaM of ox- 
aii1nat1on» for tpproval. It U cha^nain't rotpontlMIUy to ontwrt 
that all relevant regulations have boon adhorad to. If m Intpoctor 
froei the Board of Education It present* he would utvally chair (som 
of) the orals. 

It Is Interesting to notx that In tho oral oxavlnatlon listen- 
ing coiprehenslon tasks are explicitly oxcluded* If entirely for 
the second part, then at least for the first (cf. op.clt.: 217). An- 
other curious feature Is the fKt that ailmitot are to be kept which 
are to olrror rather precisely tho nost liportant atpoctt of the ex- 
Mlnatlon, Including characUrUtIc exoiDles of the strengths and 
Meeknesses of a cwidldate's language perfontance, but recordings are 
not perwitted. 



7 Conclusion^ 

In the present piper an attaint has been Mdt to provide m o«t- 
llne of the ways In which achlevewit In a foi^lyi langoofe swch ai 
lngl*sh is assessed within tho context of tho fionMO school tyston. 
After a brief e.posltlon of tho f^ral organlsatory fraMworii of all 
rtsessnent procedjres at school, we have tried to describe the situa- 
tion for the form S - 10 and 11 - 13 of secondary education, as two 
different groups, before turning to the regulations that govern the 
conditions for the Abltur exaninatlon. It It hoped that the outline 
as presented here has provided e fair picture of the situation. fer~ 
haps unavoidably, prob^ewatlc aspects have been discussed In anre 
detail than others. To redress the balance* attention should perhaps 
be drawn again to the great flexibility and freedoai of a ^ystoai i^lch 
allows Its teachers to tailor their assessnent pro<»durot to fit 
their teaching as closely as Is conceivably possible, for nost assess* 
went purposes within the nine years In Wilch English .^s tauoht at 
school. In addition, there seetis to be an untapped potential Tor cri- 
terion-referenced assessment not sufficiently exploited so far. 

On the othor hand, there 1i little doubt that the extreav class- 
room*or1ented nons- referencing deiaanded by the 'one third' rule en- 
courages a situation In which outside criteria - I.e. questions such 
as 'How does a learner scand, and Mhat can he do with his English, 
outside this parilcuUr classroom?* - unfortunately appear to be to- 
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tally Irrtlevant. This does, Indeed, raise the questions of account- 
ability in a rather serious sense. 

As any other systew that has grown and been wdified in individ- 
ual points over a lon9er period of time, the system described has Its 
fair share of incor.sistencies and problem areas, e.g. the assessment 
of the Sonstige Mitarbeit domain, the marked written exercises, the 
dominance of the text-based procedures with their backwash effect on 
the teaching, and many others. Ho»»ver, not aH formats and proce- 
dures are problematic in themselves: if one were to pinpoint the 
single most effective measure to make the system more conpatible with 
what professional language testers would have to demand, it would be 
a move to re-organise the marking. Rater training, multiple marking 
and independent marking would go a long way towards remedying a sit- 
uation which In many ways In Its present state of unsophlsti cation 
would have to be called 'pre-sc1ent1f ic' in Spolsky's sensp of the 
word (Spolsky 1975) 



Notes 

1 For a possible distinction between e.g. te-^ts' and 'examina- 
tions* cf. Britsh Council ed. 1976. 

? Examples of tests actually used for these year-groups were made 
available to the )art1c1pants of *he conference through the 
courtesy of Hrs Irmgard Voss. 

3 A range of publications Is available to teachers seeking sugges- 
tions, exanples er>d guidelines on the problems of setting and 
marking a Klausur , e.g. Bllesenpr 1981a, 198?, Hurst et aj[.1980, 
^^uUhaupt 1983 (for coffprehenslve bibliography). ExanpTes of 
tests actually used recently were again made available to partic- 
ipants of the conference through the courtesy of Mrs Voss. 

^ Again, examples were made available through courtesy of Mrs Voss. 

5 For publications on the Abl tur regulations (exanplcs, discussions, 
criticism etc ) see releVanFTi t les in the bibliography. 
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